Web Survey Bibliography
Online experiments are widely used nowadays in scientific research. However this methodological approach is seldom found in commercial market and social research. This surprises since online surveys are an ideal platform by offering the chance to systematically vary stimulus material. In this submission the methodological approach including some general results for three online experiments carried out for the group of the "Öffentlich-rechtlichen Versicherer" is presented. Furthermore implications for the application of online experiments in commercial market and social research are drawn.
The first experiment's goal was the optimization of website content featured on insurance sites. The stimulus material consisted of different information pages with the topic "private retirement insurance", in which pictures, text styles, structure, and text amount varied. Approx. 250 people participated in the experiment. The results show how information pages on the internet should be designed in the insurance branch.
In the second experiment, a suitable and catching name for a website had to be found. Stimulus material consisted of the result page of a search engine, in which the different names, contents, text lengths, and position of the entry were systematically varied. Approx. 240 people participated in this experiment. As a result, one favorite name could be clearly determined and general recommendations in respect to search engine results be given.
In the third experiment the optimal combination of picture and text material for the product "occupational disability insurance" was investigated. The stimulus material consisted of website excepts which were fully randomized created. In respect to text, the text style (e.g., "angst induction", "hard facts", or "without reasons") as well as text structure (continuous text, question-answer- and bullet-point-style) were altered. Furthermore, the number of pictures (1, 2, or 3) and the picture motive (e.g., "young people in jobs", "individual people", or "accident motives") were varied. It was determined how the combination of text in picture on insurance websites can be optimized and which effects e.g. on text appeal, objectivity, and image can be expected.
As a conclusion the possibilities of online experiments in commercial market and social research are presented and areas of application beyond the insurance branch are pointed out.
In der wissenschaftlichen Forschung sind Online-Experimente mittlerweile weit verbreitet. Dagegen findet sich in der kommerziellen Markt- und Sozialforschung dieser methodische Ansatz nur vereinzelt, obgleich die Durchführung von Online-Befragungen die ideale Plattform hierfür darstellt, indem systematische Variationen in Stimulusmaterialien vorgenommen werden können. In diesem Vortrag soll das methodische Vorgehen mit einigen allgemeinen Ergebnissen aus drei für die Gruppe der Öffentlich-rechtlichen Versicherer durchgeführten Online-Experimenten dargestellt werden. Des weiteren werden Implikationen für den Einsatz von Online-Experimenten in der kommerziellen Markt- und Sozialforschung gezogen.
Innerhalb des ersten Experiments stand die Optimierung des Contents von Versicherungswebsites im Vordergrund. Als Stimulusmaterial wurden verschiedene Informationsseiten zum Thema "Private Rentenversicherung" verwendet, in denen Elemente wie Bilder, Textstile, Strukturierung, und Textmenge variiert wurden. An dem Experiment nahmen rund 250 Personen teil. Die Ergebnisse liefern konkrete Aussagen darüber, wie Informationsseiten im Internet für Versicherungen gestaltet werden sollten.
Im zweiten Projekt wurde ein Experiment durchgeführt, um die Namensfindung für ein neues Versicherungsportal zu erleichtern. Hierzu wurde als Stimulusmaterial die Ergebnisseite einer Suchmaschine konstruiert, in der die Namensvorschläge, Inhalte und Länge der Erklärungstexte, sowie Position des Eintrags systematisch variiert wurden. An dem Experiment nahmen rund 240 Probanden teil. Als Ergebnis konnte ein eindeutiger Favorit ermittelt werden sowie allgemeine Empfehlungen zur Gestaltung von Suchmaschineneinträgen gewonnen werden.
Im dritten Projekt wurde die optimale Zusammenstellung von Bild- und Textelementen im Bereich der Berufsunfähigkeitsversicherung untersucht. Als Stimulusmaterial dienten Websiteauszüge, die vollständig randomisiert erstellt wurden. Textlich variiert wurde der Stil (z. B. "Angstinduktion", "harte Fakten" oder "ohne Begründung") sowie die Strukturierung der Texte (Fließtext, Frage-Antwort- und Bulletpoint-Stil). Weiterhin variiert wurde die Anzahl von Bildelementen (1-3 Bilder) sowie die Motive (z. B. "junge Personen im Beruf", "losgelöste Menschen" oder "Unfallmotive"). Als Ergebnis ließen sich eindeutige Richtlinien ableiten, wie sich die Kombination aus Bild und Text optimieren lässt und welche Effekte bspw. auf textliche Ansprache, Objektivität und Image zu erwarten sind.
Zusammenfassend werden die Möglichkeiten von Online-Experimenten in der kommerziellen Markt- und Sozialforschung dargestellt und Anwendungsfelder über die Versicherungsbranche hinaus aufgezeigt.
Homepage - conference (abstract)
Web survey bibliography (4086)
- Do print and Web surveys provide the same results?; 2004; Huang, H.-M.
- Will Web Surveys Ever Become Part of Mainstream Research?; 2004; Schonlau, M.
- Online or Not Online? A Comparison of Offline and Online Surveys Conducted in the Context of 2002 German...; 2004; Faas, T.
- Recruitment for online access panels; 2004; Goeritz, A.
- Does Voice Matter? An Interactive Voice Response (IVR) Experiment; 2004; Couper, M. P., Singer, E., Tourangeau, R.
- No calibration required. Expanding the use of on-line research for new initiatives; 2004; Rogers, G., Dierckx, J.-H.
- A Comparison of Objective Characteristics and User Perception of Web Sites; 2004; Lee, S.-J., Lee, W.-N., Kim, H., Stout, P. A.
- The Effect of Billboards within the Gaming Environment; 2004; Chaney, I. M., Lin, K.-H., Chaney, J.
- Pros and cons of paper and electronic surveys; 2004; Porter, S. R.
- The Influence of Incremental Increases in Token Cash Incentives on Mail Survey Response; 2004; Trussell, N., Lavrakas, P. J.
- The impact of material incentives on response quantity, response quality, sample composition, survey...; 2004; Goeritz, A.
- Spacing, Position, and Order: Interpretive Heuristics for Visual Features of Survey Questions; 2004; Tourangeau, R., Conrad, F. G., Couper, M. P.
- The Influence of Graphical and Symbolic Language Manipulations on Responses to Self-Administered Questions...; 2004; Christian, L. M., Dillman, D. A.
- Scientific LogAnalyzer: A Web-based tool for analyses of server log files in psychological research; 2004; Reips, U.-D., Stieger, S.
- Identifying and Reducing Response Burdens in Internet Business Surveys; 2004; Haraldsen, G.
- The Ethics of Conducting E-Mail Surveys; 2004; Krishnamurthy, S.
- Readings in Virtual Research Ethics: Issues and Controversies; 2004; Buchanan, E. A.
- Validity of Data and Representativeness of Sample in Internet Survey; 2004; Katz, B., Matsuo, Hi., McIntyre, K., Tomazic, T., Bosch, R.
- Digital Audio File Recording in CATI Instruments; 2004; White, E., Kraft, J., Taylor, W.
- Online Surveys-Does One Size Fit All; 2004; Coates, D.
- E-Mail Contacts: A Test of Complex Graphical Designs in Survey Research; 2004; Whitcomb, M. E., Porter, S. R.
- Impacts of the Use of E-Mail and the Internet on Personal Trip-Making Behavior; 2004; Tonn, B. E., Hemrick, A.
- How You Ask Counts: A Test of Internet-Related Components of Response Rates to a Web-Based Survey; 2004; Trouteaud, A. R.
- Changing from PAPI to CAPI: A Longitudinal Study Dealing with Mode-Effects in the German Socio-Economic...; 2004; Schraepler, J.-P., Schupp, J., Wagner, G. G
- Collecting Data on Ego-Centered Social Networks on the Web: Methodological Issues; 2004; Lozar Manfreda, K., Vehovar, V., Hlebec, V.
- Effects of Mode of Interview, and moderating variables on Erectile and Ejaculatory Function Measures; 2004; Catania, J. A., Rosen, R. J., Wood Johnson, R., Jacobs, S., Sallis, J., Shpilsky, A.
- On the Variability of Estimates Based on Propensity-score-weighted Data from Web Panels; 2004; Forsman, G., Danielsson, S., Isaksson, A.
- The Online Survey: Its Contributions and Potential Problems; 2004; McIntyre, K., Tomazic, T., Katz, B., Matsuo, Hi.
- Raising response rates: What works?; 2004; Porter, S. R.
- The Internet: Marketing Researcher's Panacea or Pandora's Box?; 2004; Gurney, P. M., Chambers, E., Grant, L., Shah, S., Sullivan, M. P.
- Reading in Virutal Research Ethics; 2004; Anonymous
- Picture This! Exploring Visual Effects in Web Surveys; 2004; Couper, M. P., Tourangeau, R., Kenyon, K.
- Developing automated e-survey and control tools: an application in industrial management; 2004; Scornavacca Jr., E., Becker, J. L., Barnes, S.
- Gathering faculty teaching evaluations by in-class and online surveys: their effects on response rates...; 2004; Dommeyer, C. J., Baum, P., Hanna, R. W., Chapman, K. S.
- Survey Mode Preferences of Business Respondents; 2004; Tarnai, J., Paxon, M. C.
- Using progress indicators in web surveys; 2004; Heerwegh, D.
- Web Survey Design: Paging vs. Scrolling; 2004; Peytchev, A., Crawford, S. D., McCabe, S. E., Conrad, F. G., Couper, M. P.
- Web surveys: Best practices; 2004; Umbach, P. D.
- Telephone presurveys, self-selection, and non-response bias to mail and Internet surveys in economic...; 2004; Hudson, D., Seah, L. H., Hite, D., Haab, T.
- Doing Survey Research On The Internet: Yes, Timing Does Matter; 2004; Faught, K. S., Whitten, D., Green Jr., K. W.
- Methods for Testing and Evaluating Survey Questions; 2004; Presser, S., Couper, M. P., Lessler, J. T., Martin, E., Martin, J., Rothgeb, J. M., Singer, E.
- Cutting Market Research Costs with On-Site Surveys; 2004; Dysart, J.
- Psychological Testing on the Internet: New Problems, Old Issues; 2004; Naglieri, J. A., Drasgow, F., Schmit, M., Handler, L., Prifitera, A., Margolis, A., Velasquez, R.
- Web Surveys For the Enterprise; 2004; King, N.
- Using the Online Medium for Discursive Research About People With Disabilities; 2004; Bowker, N., Tuffin, K.
- Classifying and Coding Online Actions.; 2004; Hargittai, E.
- Paper and pencil or online? Methodological Experiences from an employee survey; 2004; Poetschke, M.
- Employee surveys via Internet or paper? The influence of administration mode, anonymity, voluntariness...; 2004; Reips, U.-D., Franek, L.
- Online Experiments in Commercial Market Research; 2004; Nordmeyer, C.-F., Geissler, H., Donath, T.
- Salutation, Power and behaviour in on-line panels; 2004; Joinson, A. N., Reips, U.-D.